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I.   INTRODUCTION 

The  English  Empiricists,,  reacting  to  the  social  upheaval  of  the  late 
17th  and  early  l8th  centuries,  set  out  to  design  a  new  social  order,  and  toward 
this  goal  provided  a  number  of  idealized  models  (earlier  called  Utopias)  for 
a  government  of  men.   Now  three  centuries  later  a  surprisingly  analogous 
movement  is  under  way.   In  a  time  of  explosive  growth  of  new  information,  an 
attempt  is  being  made  to  outgrow  the  mental  bounds  of  the  human  frame:   to 
provide  a  framework  for  a  theory  of  recognition  processes,  a  government  of 
information  and  of  ideas. 

No  theory  of  complex  decision-making  systems  exists  today,   let  alone 

a  theory  for  one  of  the  oldest,  and  best-developed,  human  skills:   visual 

o 
pattern  recognition.'-  No  reliable  guide  for  viable  recognition  structures 

(visual,  auditory,  linguistic,  retrieval,  etc.)  is  available.   And  so  those 

who  would  study  such  processes  build  models:   rigid,  wooden,  even  a  little 

ridiculous,  but  models  that  partially  work  and  do  illuminate  this  area  of 

simulation  of  human  mental  skills.   Perhaps  these  models  will  one  day  transcend 

their  present  conceptual  and  engineering  barriers,  quite  as  the  models  of  the 

early  1700' s  served,  less  than  a  hundred  years  later,  as  archetypes  for  the 

governments  of  the  day. 

This  report  outlines  one  such  model,  admittedly  crude  and  primitive, 
for  a  pattern  recognition  digital  computer.   No  attempt  is  made  to  be  pre- 
maturely precise  in  areas  where  too  little  is  known  to  speak  quantitatively. 
The  report  does  however  attempt  to  map  out  a  machine  worthy  of  the  name 
pattern  re cognition- -embracing  visual  detection  and  identification,  heuristic 
coordination  of  everyday  source  material  (i.e.,  automatic  indexing,  abstracting, 
retrieval),  and  with  statistical  and  linguistic  abilities  appropriate  for  the 
new  age. 


A  prolegomena,  however,  will  be  found  in  Albert  H.  Amon:   Decision  Structure 
for  Recognition,  Digital  Computer  Laboratory  Report  No.  126  (1962).   A  careful 
distinction  must  be  drawn  between  (l)  machine  simulation  of  recognition 
facilities,  traditionally  associated  with  human  beings  (as  opposed  to 
machines),  and  (2)  direct  knowledge  of  brain  functioning,  particularly  at  a 
neurophysiological  level.   Machine  theorem  proving,  visual  pattern  recognition 
and  earlier  machine  arithmetic  are  examples  of  the  former  activity  (showing 
immense  progress  in  one  decade )--which  need  have  no  necessary  connection 
with  brain  functioning. 

2 

A  suggestive  introduction  is  given  in  R.  Narasimhan:   A  Linguistic  Approach  to 

Pattern  Recognition,  Digital  Computer  Laboratory  Report  No.  121  (1962). 
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Three  principal  processors  are  introduced:   the  pattern  articulation 
unit  (PAU)  for  visual  identif ication,   the  taxicrinic  unit  (TU)  for  hierarchal 
decision  structures  of  recognition,  and  the  high  speed  arithmetic  unit  (AU) 
for  statistical  and  scientific  computation.,   All  three  processors  are  highly 
parallel  computer  structures  of  new  organization „ 

In  particular  this  report  summarizes,  for  visual  pattern  recognition 
of  a  rather  limited  variety,  the  characteristic  areas  of  application,  data 
rate  requirements,  mode  of  analysis,  possible  digital  processors,  block 
schematic  of  an  appropriate  computer  as  a  whole,  and  finally  possible  interim 
stages  in  the  realization  of  the  machine,, 


3 

A  detailed  description  and  tentative  design  of  the  pattern  articulation  unit 

is  deferred  until  part  II.   See  B.  H.  McCormick:   Design  of  a  Pattern 

Recognition  Digital  Computer,  Part  II:   The  Pattern  Articulation  Unit  (PAU), 

Digital  Computer  Laboratory  Report  No.  122  (1962)= 
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SECTION  II.   FUNCTION  OF  THE  PATTERN  RECOGNITION  COMPUTER 

A)   AREAS  OF  APPLICATION 

The  most  effective  use  of  a  pattern  recognition  digital  computer  is  for 
scanning  and  analysis  of  massive  amounts  of  relatively  homogeneous  visual  informa- 
tion. As  a  guide  to  system  design,  it  is  therefore  useful  to  examine  critically 
a  sample  population  of  four  areas  well  adapted  to  machine  analysis:   two  from 
high  energy  physics  instrumentation,  one  from  biology  and  one  from  library  auto- 
mation. These  areas  are  the  automatic  scanning,  measuring  and  analysis  of  (i) 
bubble  chamber  negatives,  (ii)  spark  chamber  negatives,  (iii)  the  automatic  scanning, 
cataloguing  and  interconnection  listing  of  neurohistological  tissue  sections  and 
(iv)  the  automatic  scanning,  abstracting,  storage  and  retrieval  of  microfilm  of 
printed  text. 

Table  II-A  lists  for  each  of  the  four  areas  (i)  the  source  machine  which 
iteratively  generates  the  input  visual  material,  (ii)  typical  number  of  frames  per 
year  to  be  processed,  (iii)  characteristic  description  classes  to  be  used  and  (iv) 
output  information  (per  frame)  to  be  passed  on  to  subsequent  analysis  routines. 

In  summary  these  particular  areas  are  characterized  by 

(i)    homogeneity  of  the  visual  material,  frame -to -frame 

6      7 
(ii)   massive  amounts  of  data  to  be  processed:   10  to  10 

frames  per  year 

(iii)   symbol  set  to  describe  the  material  is,  except  for  area 
(iv),  a.  various  and  ill-defined  continuum. 

(iv)   limited  grey  scale,  a  simple  black-white  dichotomy,  often 
suffices 

(v)    rapid  abstraction  to  line  drawing  strongly  suggested  by 
the  nature  of  the  material 
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Output 

Information 

Area  of 

No.  Frames 

Description 

per 

Application 

Source  Machine 

per  Year 

Classes 

Frame  (Bits) 

bubble  chamber 

bubble  chambers 

3-5  x  106 

beam  track 

9  x  103 

data  processing 

secondary 

(l  frame  = 

[l  frame/beam 

track 

[3  views/frame 

1  stereo-triad) 

pulse 

electron 

2  tracks/ view 

1  beam  pulse/ 

spiral 

50  points/track 

3  sec,  33$ 

delta  ray 

2  x  15  bits/ 

effective 

glob,  flume , 

point] 

use] 

etc. 

spark  chamber 

spark  chambers 

3.5  x  107 

beam  track 

2  x  103 

data  processing 

secondary 

(l  frame  - 

[10  frames/ 

track 

[100  points/ 

1  stereo-dyad) 

beam  pulse 
1  beam  pulse/ 
3  sec,  33$ 
effective 
use] 

trays,  etc. 

frame 
20  bits/point  ] 

neurohistological 

microtome 

6.k   x  107 

dendrite 

k   x  103 

mapping 

sectioning  of 

axon 

rat  brain 

[10  rat  brains 

cell  body 

[2  projected 

(l  frame  = 
1  vidicon  field 
of  view  of 
section  with 
approximately 
l6x  objective) 

2 
10  sections 

(l  cm^  x 

100  u)/ 

brain 

(l  frame  = 

250  u  X 

250  u  X 

5  n)  k 
3.2  x  10 

stellate  cell 
afferent 

fiber 
efferent 

fiber 

neurons/ 

frame 

2 
10  coordinated 

points/ 

neuron 

2  x  10  bits/ 

coordinate ] 

frames  per 

section 

with  over- 

lap of  2] 

library 

printing  press 

10? 

alpha- 

h 
3.5  x  10 

automation 

numeric 

(1  frame  = 

[l  faculty, 

characters, 

[1  page  of  text 

(automatic 

1  page  of  text] 

103  men/ 
faculty 

10  pages/ 

simple 

50  lines/page 

abstracting  of 
j  ournal 

charts, 
etc. 

100  characters/ 

line 

material  for 

7  bits/ 

one  faculty) 

man  month 
10  months/ 
year] 

character] 

TABLE  II- A   Four  Areas  for  Possible  Application  of  Automatic  Pattern  Recognition 
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B)   PARTITIONING  AND  DIGITIZING  OF  THE  VISUAL  IMAGE 

Visual  material  must  be  digitized  before  input  to  the  pattern  recognition 
computer.  The  input  mechanism  which  performs  this  task  will  be  referred  to  as  the 
scanning  unit.   Input  visual  information  is  typically  in  frames:   one  frame  per 
bubble  chamber  stereo -triad,  spark  chamber  stereo -dyad,  vidicon  field-of-view  of 
a  neurohistological  section,  or  microfilm  frame  of  printed  text. 

Virtually  all  scanning  units  contemplated  at  present  examine  the  film 
(or  biological  section,  etc)  by  a  TV-like  scan;  that  is,  the  input  image  has 
imposed  upon  it  (conceptually)  a  two-dimensional  rectangular  (or  rhombic)  raster. 
Digital  representation  of  the  input  material  is  normally  one  of  two  dominant  forms: 
(i)  retinal,  or  (ii)  coordinate . 

For  example,  a.  bubble  chamber  stereo -triad  can  be  digitally  encoded 
in  retinal  form  by  projecting  a  square  raster  (^096  x  ^096  cells)  upon  the  frame. 
Each  cell  is  examined  to  see  if  the  negative  locally  is  above  some  minimum  opacity. 
If  so,  a  "l"  is  recorded;  alternatively,  a  "0"  is  recorded,  indicating  that  the 
negative  is  locally  transparent  (i.e.,  background  only).  Encoded  bubble  chamber 
tracks  range  from  one  to  three  cell  lengths  in  width. 

Alternatively  the  bubble  chamber  stereo -triad  can  be  digitally  encoded 
in  coordinate  form  by  scanning  the  frame  with  k0^6   parallel  sweeps  (parallel  to 
the  X-axls)  and  for  each  sweep  recording  the  X-coordinate  for  each  leading  (and 
trailing)  edge  of  every  black  mass  seen.   For  the  bubble  chamber  case  the  total 
number  of  bits  required  is  approximately  equal  for  the  two  digital  representations. 

Rarely  is  the  entire  frame  transmitted  as  a  continuous  string  of  bits. 
More  naturally  the  frame  is  partitioned  into  rectangular  subareas,  called  macro- 
cells,  often  defined  by  the  scanner  mechanism.   For  example  one  macrocell  can 

be  a.  single  sweep  across  the  film  (coordinate  representation).   Or  the  generic 

2 
macrocell  can  conveniently  be  a.  small  square  -  1  mm  of  film  -  corresponding 

to  a.  32  x  32  subraster  (retinal  representation).   For  the  bubble  chamber  case 

3  h 

these  macrocells  each  require  approximately  10  bits;  the  frame  itself,  10 

7 

macrocells  -  or  10  bits  total  for  the  frame. 

In  the  digitizing  process  it  is  convenient  to  distinguish  between 
scanning  and  measuring.   For  some  areas,  e.g.,  alpha-numeric  recognition, 
measuring  normally  plays  no  role.   In  general,  measuring  plays  an  auxiliary 
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role  to  scanning.   For  bubble  chamber  data  processing,  events  of  interest  are 
currently  observed  by  human  observers  examining  the  projected  frame  on  scanning 
tables.   Here  the  inferior  projection  optics  of  these  tables  can  introduce  con- 
siderable image  distortion.  The  first  image  filtering,  or  recognition  processes, 
would  appear  nominally  independent  of  mild  image  distortion.   In  fact  a.  human 
scanner  can  find,  -without  difficulty,  events  of  interest  in  play -back  photographs 
of  retinally-encoded  film  even  though  the  oscilloscopic  scan /playback  system  has 
introduced  distortions  of  5$. 

In  contrast,  for  measurement,  resolution  of  one  part  in  ten  of  a  track 
width  is  employed  at  present  and  comparable  linearity  held  over  the  entire  face 
of  the  film.  This  added  coordinate  resolution  is  required  only  for  (typically) 
ten  per  cent  of  the  tracks  in  a  frame  -  so  that  slower  speed  high  resolution 
procedures  can  be  called  into  play  where  needed,  without  significant  deterioration 
of  the  overall  processing  rate.  Accordingly  a,  traditional  separation  of  visual 
data  processing  into  a  scanning  and  a  precision  measuring  phase  has  grown  up. 

Occasionally  a.  mixed  digital  representation  of  a  visual  image  is  used 
in  which,  starting  from  a  coordinate  representation,  the  most  significant  digits 
of  black  points  are  used  to  define  a  coarse  retinal  image,  the  least  significant 
digits  are  stripped  off  as  vernier  coordinates  to  be  recalled  only  if  interpreta- 
tion of  some  event  in  the  coarse  visual  image  warrants  further  detailed  analysis. 
A  prime  example  can  be  given  for  the  spark  chamber,  where  (say)  each  of  32  bands 
between  alternately-charged  plates  can  be  rudely  subdivided  into  32  cells.  Any 
triggering  of  the  chpmber  then  gives  rise  to  a  crude  32  x  32  image  (for  ea.ch 
stereo -view),  whereas  by  appendaging  vernier  coordinates  each  track  is  digitized 
to  one  part  in  102*+,  or/vlm  for  a  chamber  with  plates  one  meter  square. 
Here  the  scanning  phase  (rude  recognition  of  events  within  the  32  x  32  subraster) 
is  qualitatively  different  from  the  measuring  phase  (attachment  of  vernier  coor- 
dinates prior  to  kinematic  interpretation). 

It  is  entirely  consistent  to  use  one  instrument  for  both  scan  and 
measurement  purposes,  as  is  done  in  the  Hough-Powell  optical -mechanical  digitizer. 
In  like  manner  the  newer  oscilloscopic  systems  give  promise  of  handling  both 
functions:  a  very  fast  (open-loop)  scanning  mode  applied  universally;  a  slower 
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(closed-loop,  referencedto  an  optical  grating)  measuring  mode  of  those  film 
areas  singled  out  as  a  result  of  processed  scan  information. 

Neither  the  scanning  unit,  nor  the  measuring  unit,  performs  a  pattern 
recognition  function.   Input  hit  patterns  are  arbitrary,  as  far  as  these  units 
are  concerned,  and  reflect  the  general  purpose  nature  of  the  overall  recognition 
system.   The  interpretation  of  the  input  bit  information  (i.e.,  pattern 
recognition)  is  a  function  of  neither  the  scanning  nor  the  measuring  unit, 
but  of  the  subsequent  processor—the  pattern  recognition  computer  proper. 

It  should  be  emphasized  that  none  of  the  scanning  procedures  discussed 
above  need  (in  principle)  make  more  than  one  pass  over  the  visual  image.    At 
each  step  the  local  opacity  of  the  material  is  simply  matched  to  a  preselected 
grey  scale  (most  often  just  black,  white)..   At  no  point  are  comparisons  on 
consecutive  scans  implied0   Note  that,  unlike  the  corresponding  situation  for 
a  magnetic  tape  unit,  a  second  pass  over  the  visual  image  will  normally  give 
a  different  encoded  pattern  of  bits,  reflecting  the  intrinsic  ambiguity  of 
forcing  a  black-white  dichotomy  upon  material  with  extended  grey  scale. 

In  this  report,  our  attention  will  be  focused  upon  material  best 
scanned  and  processed  in  retinal  form:   material  in  fact,  from  all  four  of 
the  above  sample  areas  of  application,  with  the  proviso  that  for  the  spark 
chamber  case,  a  coarsely  digitzed  image  is  first  examined.   For  high  resolution 
photography  one  frame  can  be  retinally  encoded  on  a  U096  x  h-0^6   raster;  lower 
quality  photographic  images,  or  "high  resolution"  vidicon  scans,  scarcely 
warrant  a  1024  x  102^  raster. 


Certain  recognition  schemes  require  that  each  area  of  the  visual  image  be 
multi-scanned  (e.g.,  several  passes  of  a  line  element  at  various  angular 
orientations),  and  that  a  comparison  of  the  output  of  consecutive  passes 
be  made.   A  unit  which  performs  these  functions  will  here  be  classified 
as  a  preprocessor,  independent  of  whether  the  comparison  is  performed 
using  analog  or  digital  circuitry  or  both.   Mechanization  of  the  comparison 
function  is  the  distinguishing  feature  of  these  units. 
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C)   DATA  RATES 

Table  II-C  below  summarizes  data  rate  information  for  each  of  the 
four  suggested  areas  of  application  of  a  pattern  recognition  computer.   Input 
data  rates  are  derived  from  the  problem  descriptions  of  Table  II-A.   From  (i) 
input  frames/sec  and  (ii)  raster  resolution  are  computed  (iii)  input  data  rates 
(bits/sec  )0   Output  data  rates  are  summarized  in  (vi)  output  (bits/sec)  as 
computed  from  (iv)  output  information  per  frame  and  (v)  the  output/input  ratio 
for  the  material  in  question. 

Certain  features  are  readily  apparent.   First,  the  input  data  rate 
for  all  areas  is  remarkable  uniform,  approximately  2  x  10  bps .   The  small 
variance  between  tasks  of  this  input  rate  stems  from  the  observation  that  the 
equivalent  human  scanning  effort  (averaged  over  one  year)  in  each  area  is 
approximately  20  man  years.   (The  measuring  or  transcribing  time,  while  not 
significant  in  a  fully  automatic  system,  could  absorb  20  or  more  man  years  in  a 
human  based  system. ) 


Input 
(seconds 

per 
frame) 

Raster 
Resolution 

Input 

(bits 

per 

second) 

Output 
(bits 
per 
frame) 

Output/ 
Input 
Ratio 

Output 
(bits 
per 

second) 

Area  of  Application 

(i) 

9 
0.9 

.  (ii) 

(iii)- 
1.9x10 

2.3x  10 

(iv) 

9xl03 
2xl03 

(v) 

0.54x  10~3 
0.95x  10~3 

(vi) 

Bubble  Chamber 
Spark  Chamber 

4096 x  4096 

1024  x  2048 

3 
10J 

'  2.2x  103 

Neurohistology 

0.5 

1024 x  1024 
(vidicon) 

2.1  x  10 

4x  103 

3.8  x  10"3 

8  x  103 

Library  Automation 

3-2 

2048x2048 

1.3x  106 

35xl03 

8.3  x  10"3 

11  x  103 

Average 

3^ 

1.9x10 

4 
1.3x10* 

3.4  x  10"3 

5.6  xlO3 

TABLE  II-C 
Summary  of  Data  Rates  for  the  Four  Areas  of  Application 
(Refer  to  Table  II-A) 


This  input  bit  rate  does  not  impose  an  intolerable  design  burden. 
It  is  estimated  that  two  oscilloscopic  scanning  units,  working  in  alteration 
(to  allow  for  film  transport  times)  could  generate  10  bits/sec,  or  more  than 
the  data  rate  for  all  four  areas  combined . 

Secondly,  considerable  condensation  is  done  in  the  automatic  scanning 
phase;  typically  the  output  amounts  to  no  more  than  0„3$  of  the  input  bit  rate. 
Nor  in  general  would  this  interim  output  be  printed  out  and  monitored;  direct 
data  reduction  normally  ensues  in  subsequent  analysis  routines  (e.g.,  stereo- 
geometric  reconstruction,  kinematic  interpretation,  and  statistical  summary  for 
the  bubble  chamber  case).   In  general  the  output  bit  rate  is  remarkably  low; 
even  at  a  negligible  k:l   subsequent  reduction  the  output  of  all  four  scanning 
tasks  combined  could  be  matched  by  a  commercially  available  mechanical  line 
printer. 

In  summary  the  data  rates  of  Table  II-C  for  all  four  areas  combined 
are  entirely  consistent  with  i)  a  moderate  number  of  oscilloscopic  scanning 
units  (estimated  at  two),  and  ii)  a  data  channel  of  under  500  words/sec  (50 
bits/word)  to,  for  example,  a  fast  arithmetic  computer.   Data  rate  information 
alone  is  insufficient  to  estimate  the  feasibility  of  a  preprocessor  capable 
of  matching  this  scanning  load.   However,  an  examination  of  detailed  design  of 
the  pattern  articulation  unit  (PAU)  discussed  in  Part  II  suggests  that  this 
preprocessor  could  come  within  a  factor  of  2  of  handling  the  combined  scanning 
load  of  all  four  areas „ 


Obviously  nothing  like  this  amount  of  printout  would  be  tolerated  by  any 
sensible  packet  of  programs. 
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D)   OVERALL  MODE  OF  ANALYSIS 

1 )  Distinction  "between  Local  and  Global  Geometric  Order 

Patterns  of  typical  photographs  exhibit  both  local  and  global  geometric 
order.   Within  one  photographic  negative,  for  example,  local  recognition  might 
be  used  to  recognize  the  leaves  of  a  tree,  global  recognition  to  describe  the 
shape  of  the  tree  as  a  whole.   Or  another  example,  alpha-numeric  symbols  in 
one  commercial  data  display  unit  (CRT)  are  constructed  within  assigned  5x7 
digital  subrasters.   The  bit  patterns  within  the  subrasters  exhibit  local  order; 
the  sentences  of  text,  global  order.   At  present  few  invariant  procedures  for 
global  recognition  are  known,  and  the  techniques  employed  vary  widely  with  the 
choice  of  material. 

Again,  consider  the  description  of  a  bubble  chamber  stereo-triad.   A 
bubble  chamber  negative  may  be  regarded  as  constructed  of  overlapped  line 
segments.  These  line  segments  are  one  to  two  raster  cell  division  wide,  five 
to  eight  cell  divisions  long,  variously  oriented,  and  in  general  contains  gaps. 
Here  the  object  of  local  recognition  is  to  detect  these  elemental  line  segments 
and  their  points  of  intersection,  termination,  etc.   The  composition  of  these 
segments  into  beam  tracks,  secondary  prongs,  electron  spirals,  etc.,  more 
properly  belongs  to  global  recognition. 

This  qualitative  distinction  between  local  and  global  order  suggests 
a  linguistic  approach  to  pattern  recognition  wherein  image  analysis  comprises 
two  well-defined  phases : 

I.   a  parallel  preprocessing  phase,  and 

II.   a  sequential  compiling  phase. 

The  principal  features  of  these  two  phases  are  summarized  below. 

2 )  Phase  I:   Parallel  Preprocessing 

The  object  of  parallel  preprocessing  is  twofold: 

(i)    idealization  of  the  input  picture  (noise  cleaning,  etc.),  and 


R.  Narasimhan,  A  Linguistic  Approach  to  Pattern  Recognition,  Digital  Computer 
Laboratory  Report  121  (1962) 
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(ii)   abstraction  of  the  idealized  image  as  an  abstract  graph  for 
use  in  Phase  II  of  the  recognition  procedures. 

Image  idealization  consists  principally  of  edging,  thinning,  gap- 
filling,  and  line  smoothing.   The  original  image  is  reduced  to  an  idealized 
line  drawing,  and  points  defining  end  points,  junctions,  bends,  corners,  etc., 
selected  out.   These  latter  terms  are  the  basic  syntactic  categories  for  which 
the  grammar  of  Phase  II  is  defined. 

3 )   Phase  II:   Sequential  Compiling 

At  the  conclusion  of  Phase  I  the  original  image  has  been  reduced  to  an 
idealized  line  drawing.   The  line  drawing,  in  turn,  can  be  further  idealized 
into  an  abstract  graph- -that  is,  a  set  of  nodes  and  branches  (pairs  of  nodes 
connected  by  a  simple  line  segment).   In  general  the  nodes  belong  to  several 
different  categories  (e.g.,  end  points,  junctions,  corners,  etc.).   In  like 
manner  for  each  class  of  pictures  there  are  several  varieties  of  line  segments 
usefully  distinguished:   horizontal  stroke,  vertical  stroke,  left  and  right 
diagonal  stroke,  curved  arc,  zig-zag,  etc.   Algorithms  for  tracking  between 

connected  nodes  are  sufficiently  simple  to  admit  efficient  mechanization 

2 
directly  within  the  parallel  preprocessing  phase. 

Algorithms  for  interpreting  the  resulting  abstract  graph,  however,  can 
be  immensely  varied  and  are  in  general  unsuited  for  fixed,  wired- in  mechanization, 
These  algorithms  constitute  the  processes  of  Phase  II. 

It  is  envisaged  that,  ultimately,  this  sequential  phase  will  consist 
of  a  hierarchical,  recursive  program  with  its  principal  part  functioning  very 
much  like  the  syntax-compilers  used  in  automatic  programming. 

h)     Design  Implications 

A  first  pattern  processing  unit,  appropriate  for  parallel  preprocessing 
of  the  image  (Phase  l),  must  be  optimized  for  detection  and  exploitation  of 
local  order,  typically  coherence  subpatterns  of  bits  extending  over  8x8  cell 


2 

See,  for  example,  the  discussion  of  the  "flash-thru"  mechanism  in  Sections 

III-B,  V-G  of  Digital  Computer  Report  Ntf.  l$2v-   •  ■-■'>     m   , 
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divisions  in  area  or  less.   The  symbols  of  this  substructure  must  then  be 
linked  into  the  larger  units  to  form  the  abstract  graph.   We  have  chosen  to 
call  the  processor  that  performs  these  two  functions  the  Pattern  Articulation 
Unit  (PAU),  in  line  with  the  root  meaning  of  the  verb  articulate :   to  utter 
distinctly,  properly,  to  divide  into  joints. 

A  processor  of  such  design,  in  general,  in  no  satisfactory  way 
embraces  global  order- -and  correctly,  for  the  data  rate  problem  lies 
predominately  in  the  local  recognition  area.   Our  impression  is  that  long- 
range  order  assumes  a  vast  wealth  of  forms  varying  widely  from  problem  to 
ptoblem,  and  is  ill-suited  to  either  wired-in  or  local  bit  logic.   Furthermore, 
provided  local  recognition  facilities  reduce  the  data  rate  adequately,  analysis 
of  global  order  may  often  be  done  adequately  by  stored  program  subroutines  run 
within  a  short  word  length  computer  of  more  conventional  design.   We  shall 
refer  to  this  semi -conventional  processor  (running  concurrently  with  the 
parallel  PAU)  as  the  Taxicrinic  Unit  (TU)  to  emphasize  its  principal  activity: 
the  manipulation,  search,  and  systemization  of  abstract  graphs  (decision  tree 
structures,  etc.).   These  processes  can,  of  course,  be  carried  on  within  a 
contemporary  arithmetic  computer,  and  programming  techniques  such  as  list 
processing  have  been  introduced  to  expedite  the  writing  of  code  here.   It  is 
increasingly  recognitzed,  however,  that  the  contemporary  arithmetic  computer 
is  poorly  matched  to  analysis  situations  making  virtually  no  use  of  arithmetic, 
in  which  the  most  commonly  employed  order  is  a  transfer  instructions.   Processors 
specifically  adapted  to  graph  manipulation  and  interpretation  can  be  expected 
within  the  next  few  years  to  take  their  place  in  importance  and  utility  side 
by  side  with  the  arithmetic  unit. 

For  some  pattern  recognition  problems  learning  and  generalization  are 
appropriate  and  important  ingredients.   Here  the  use  of  Monte  Carlo  techniques 
in  conjunction  with  linear  associational  logic  is  suggested.   For  this  subclass 
of  problems,  devices  (e.g.,  perceptrons )  designed  specifically  for  this  mode  of 
analysis  might  later  be  introduced  as  powerful  adjuncts  to  the  Taxicrinic  Unit 


3  / 

From  the  Greek:   Ta|(cr:   rank,  arrangement  (originally,  pattern)  andXp//"): 

to  judge. 
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(see  below).   For  this  class  of  problems  Phase  II  would  appear  to  be  the 
earliest  level  at  which  to  introduce  the  perceptron  model,  and  then  principally 
as  a  heuristic  guide  to  alternative  paths  of  pattern  analysis. 

In  summary,  consistent  with  the  separation  between  local  and  global 
order,  we  visualize  the  pattern  recognition  computer  as  dividing  naturally 
into  two  (coupled)  processors: 

(i)  a  Pattern  Articulation  Unit  (PAU)  of  large  word  size  (10 
bits  or  greater)  for  parallel  preprocessing  of  the  image 
(Phase  i),  and 

(ii)   a  Taxicrinic  Unit  (TU)  to  compile  appropriate  summary 
information  extracted  from  the  PAU  output  (e.g.,  the 
abstract  graph)  in  order  to  identify  and  describe  the 
pattern  (or  patterns)  in  the  picture. 


k 


Bernard  Widron,  Generalization  and  Information  Storage  in  Networks  of  Adaline 
"Neurons"  presented  at  the  Conference  on  Self-Organizing  Systems,  sponsored 
by  the  Office  of  Naval  Research  and  the  Armour  Research  Foundation,  Chicago, 
May,  1962. 
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III.   DESCRIPTION  OF  THE  PATTERN  RECOGNITION  COMPUTER 

A)   SCHEMATIC  OF  THE  PATTERN  RECOGNITION  COMPUTER 

Having  made  some  general  remarks  about  areas  of  application  and  a 
possible  mode  of  analysis  for  pattern  recognition,  it  is  appropriate  to  loosely 
map  out  a  block  schematic  of  a  suitable  computer. 

In  Figure  III-A  the  central  processor  of  the  machine  has  been 
expanded  to  three  units:   the  pattern  articulation  unit  (PAU),  the  taxicrinic 
unit  (TU)  and  the  arithmetic  unit  (AU).   Each  of  these  units  is  treated  in  more 
detail  in  later  sections.   These  processors  are  augmented  by  an  input/ output 
unit  (i/o),  which  provides  not  only  conventional  facilities  (i.e.,  magnetic 
tape,  disk  file,  printer,  etc.),  but  in  additional  allows  the  scanning, 
measuring,  and  recording  of  visual  material  (i.e.,  oscilloscope  and  vidicon 
scanning  units,  optico-mechanical  devices,  etc.). 

For  certain  classes  of  problems  (in  particular,  for  bubble  chamber 
data  processing)  each  of  the  three  central  processors  can  function  independently 
for  extended  periods  (comparable  to  one  second)  without  more  than  sequential 
pass  of  information  from  the  high  resolution  oscilloscope  to  the  PAU,  from  the 
PAU  to  the  TU,  and  from  the  TU  to  the  AU.   For  such  cases  a  natural  mode  of 
operation  is  to  assign  each  processor  an  independent  block  of  memory  with 
separate  addressing.   In  well-balanced  operation  each  processor  might  be 
expected  to  require  a  memory  bank  of  8192  words  of  storage,  augmented  by  rapid 
block  transfer  of  processing  routines  to/from  the  backup  store. 

For  other  data  processing  tasks  the  load  on  each  processor  may  not 
be  balanced,  and  a  reapportionment  of  available  memory  is  in  order.   The 
control  of  memory  allocation  is  the  function  of  the  memory  interface.   Also 
assigned  to  this  unit  is  address  construction  (indexing,  deferred  addressing, 
etc.)  for  each  of  the  three  central  processors.   All  addresses  used  within  a 
processor  are  relative,  and  indexed  only  at  the  memory  interface.   Accordingly 
this  unit  also  governs  the  transfer  of  information  between  processors  by 
appropriate  address  modification.   Beyond  this,  the  memory  interface  attempts 
to  present  to  the  individual  processor  the  illusion  that  available  memory  is 
an  (infinite)  homogeneous  sea  of  words. 
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Individual  processors  may  have  separate,  special  purpose  memories  not 
under  control  of  the  memory  interface.   For  example  the  design  of  the  PAU 
incorporates  two  memories:   the  transfer  memory--a  special  purpose  associative 
memory  used  in  buffering  the  1024  bit  words  (patterns )  of  that  processor, 
and  a  micro- instruction  control  memory. 

The  design  of  the  pattern  recognition  computer  is  not  predicated 
exclusively  on  reducing  data  processing  times  to  a  minimum.   The  objective 
of  computer  fabrication  is  not  only  numbers,  but  perception- -new  partitioning 
of  the  problem  through  algorithms  only  obvious  in  a  machine  of  new  structure. 
In  decision  tree  search  algorithms,  for  example,  improvement  in  the  search 
heuristic  makes  an  exponential  increase  in  the  processing  rate;  improvement 
in  the  speed  of  the  computer,  a  linear  increase.   Using  a  faster  computer  of 
conventional  design  in  presently  circumscribed  ways  is  for  many  problems  rather 
like  getting  a  stepladder  to  touch  the  moon.   If  however  the  machine  (e<,g., 
taxicrinic  unit,  etc.  )  by  ingeneous  match  of  order  code  and  organization, 
throws  into  new  relief  old  search  algorithms  and  suggests  new  means  of 
manipulating  tree-like  structures,  then  it  will  admirably  serve  its  purpose. 


The  introduction  of  the  PAU  design  suggests,  for  example,  that  ALGOL  is  by 
no  means  the  universal  computer  language  its  advocates  often  profess. 
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b)  the  pattern  articulation  unit  (pau) 

The  pattern  articulation  unit  (PAU),  a  parallel  preprocessor  for 
retinally-encoded  visual  images,  was  introduced  in  Section  II-D.   The  logical 
design  of  this  digital  processor  is  optimized  for  the  idealization  of  the  input 
image  to  a  line  drawing.   In  addition,  facilities  (pyramidal  readout)  are 
provided  to  extract  as  a  list  the  abstract  graph  describing  the  interconnection 
of  the  labelled  nodes  (end  points,  bends,  points  of  intersection,  etc.)  of 
this  idealized  line  drawing. 

The  central  core  of  the  PAU  consists  of  1024  identical  processing 
modules  (stalactites)  placed  at  the  sites  of  a  two-dimensional  Bravais  net 
(32  x  32).   At  the  programmer's  option  the  array  can  be  considered  as  a 
rectangular  arrangement  of  modules,  or  alternatively  as  a  rhombic  lattice. 

All  parallel  processing  is  done  as  a  sequence  of  homogeneous  logical 
transformations   on  the  digitized  input  image.   That  is,  the  new  value  ("0"  or 
"l")  assigned  to  a  site  is  a  specified  boolean  function  of  the  output  of 
neighboring  sites.   Neither  the  selection  of  relative  neighbors  involved  nor 
the  boolean  dependence  is  allowed  to  change  site-to-site.   Accordingly,  common 


A  number  of  cellular  computers  (automata)  have  been  suggested: 

(i)    S.  H.  Unger,  "A  Computer  Oriented  Toward  Spatial  Problems," 
Proc.  IRE,  Vol.  46,  pp.  17M+-1750  (1958);  and  "Pattern 
Detection  and  Recognition,"  Proc.  IRE,  Vol.  47,  pp.  1737-1752 
(1959) 

(ii)   Arthur  W.  Burks,  "Notes  on  John  von  Neumann's  Cellular  Self- 
Reproducing  Automata, "  Digital  Computer  Laboratory  Report 
No.  108  (unpublished),  University  of  Illinois,  I96I 

(iii)  John  H.  Holland,  "iterative  Circuit  Computers,"  Proc. 
Western  Joint  Computer  Conference,  i960 

(iv)  J.  L.  Divilbiss  and  B.  H.  McCormick,  "Tentative  Logical 
Realization  of  a  Pattern  Recognition  Computer, "  Digital 
Computer  Laboratory  File  No.  403,  University  of  Illinois, 

*96l 

Only  references  (i)  and  (iv)  are  primarily  directed  toward  pattern  recognition, 

2 

For  fuller  treatment,  see  Section  III-A  of  Digital  Computer  Laboratory 

Report  No.  122. 


■16- 


control  signals  are  sent  to  all  modules.   The  number  of  control  lines  is 
independent  of  the  array  size  (i.e.,  number  of  stalactites).   In  particular 
the  array  can  function  as  a  two-dimensional  shift  register. 

It  is  observed  from  empirical  simulation  studies  that  line  width 
normalization  (thinning)  can  be  realized  with  simple  AND,  OR,  NOT  boolean 
functions  of  the  output  of  nearest  neighbors. 

Gap  filling,  however,  implicitly  involves  an  estimation  of  size--a 
counting  operation,  or  less  restrictively,  threshold  logic.   Eight  consecutive 
bits  of  the  internal  storage  register  of  the  stalactite  are  made  "self-ordering"-- 
a  fixed  number  of  identical  operations  will  order  the  contents  of  the  register 
so  that  all  "zeros"  rise  to  the  top,  all  "ones"  precipitate  to  the  bottom  of 
the  vertically  aligned  stalactite.   Once  this  canonical  form  threshold  logic 
is  achieved  by  sampling  (in  parallel)  and  contents  of  all  internal  flipflops 
of  given  depth. 

And,  finally,  tracking  of  an  oriented  path  of  connected  black  cells 
is  required  to  associate  nodal  points  common  to  the  same  track  of  the  abstract 
graph.   This  operation  is  succinctly  realized  by  allowing  the  stalactites  to 
build  a  signal  path  from  node  to  node.    Each  module  (in  parallel)  sets  a 
selector  switch  to  its  nearest  connected  neighbor  along  the  path. 

Provision  of  the  above  logical  processing  facilities  and  insistence 
that  each  module  reflect  all  trans lational,  rotational,  reflectional  symmetries 
of  the  embedding  Bravais  net  almost  uniquely  determines  the  internal  construc- 
tion of  the  generic  stalactite—assuming  a  minimum  number  of  active  elements 
per  module  are  used,  consistent  with  good  instruction  time  balance.   The  present 
stalactite  requires  ^t-0  control  signal  lines;  the  general  PAU  micro-instruction 
is  52  bits  to  encompass,  in  addition,  buffering  of  the  102^-bit  word  in  a 
transfer  memory,  border  input/output,  and  pyramidal  readout  instructions.   A 


3 

Suggested  to  us  by  Albert  H.  Amon;  the  logical  realization  of  this  mechanism 

within  the  stalactite  was  found  by  us  later  and  profoundly  influenced stalactite 

design.   Somewhat  similar  facilities,  without  particular  reference  to  pattern 

recognition,  have  been  discussed  by  Holland,  reference  (6iii)  above.   However, 

the  particular  and  important  feature  of  building  the  path  in  parallel  is  new. 

This  path  building,  in  parallel,  can  be  generalized  into  link-forming 

decision  structures.   See  A.  H.  Amon,  Digital  Computer  Laboratory  Report 

No. 126,  ibid. 
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stalactite  requires  approximately  49  transistors,  230  diodes,  54  capacitors, 
and  246  resistors.   One  stalactite  is  packaged  on  a  5"  x  5"  printed  circuit 
card. 

Future  machines  of  this  class  would  appear  well-adapted  to  fabrication 
by  integrated  semiconductor  circuitry,  for  (i)  all  modules  are  identical,  (ii) 
have  identical  control,  and  (iii)  exhibit  maximal  internal  symmetry. 


4 

Stalactite  circuit  realization  and  test  has  been  done  by  K.  C.  Smith.   See 

K.  C.  Smith,  Design  of  Circuits  for  the  Pattern  Recognition  Unit,  Digital 

Computer  Laboratory  Report  No.  127,  1962. 
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C)   THE  TAXICRINIC  UNIT  (TU) 

A  digital  processor,  the  taxicrinic  unit,  was  proposed  in  Section  II-D, 
By  its  logical  design  this  unit  would  be  optimized  for  the  manipulation, 
searching,  and  interpretation  of  abstract  graphs.   The  need  for  a  processor 
of  this  type  has  been  recognized  in  many  areas  including  pattern  recognition, 
information  storage  and  retrieval,  automatic  design  of  automata,  compiling, 
mechanization  of  heuristic  problem  solving,  machine  translation  of  natural 
languages,  and  machine  taxonomy. 


include 


Problems  in  these  areas  share  the  following  attributes.   These 

(i)  they  are  readily  mapped  into  an  abstract  graph  (with 
relatively  few  bits  of  tag  information  per  branch  or 
node), 

(ii)   the  graph  so  generated  is  enormously  branched, 

(iii)  no  analytical  search  algorithm  is  generally  available, 
and 

(iv)   /hierarchal  structure  is  often  crucial  to  a  statement 
of  the  problem  solution  (e.g.,  grammar  in  languages, 
sequence  of  statements  in  a  proof,  genetic  tree  in 
taxonomy ) . 

Although  these  problems  share  the  attributes  listed  above,  it  is  not  asserted 
that  a  taxicrinic  unit  alone  will  suffice  for  all  areas.   Dictionaries,  special 
purpose  input/ output,  etc.,  are  equally  important  tools  for  the  mechanization 
of  many  of  these  problem  areas. 

It  is  important  to  distinguish  between  the  problem  area  and  the 
appropriate  processor  for  this  area.   For  example,  the  arithmetic  unit  is  not 
referred  to  as  the  matrix- inversion  processor—for  arithmetic  is  the  root 
process,  matrix  inversion  the  derived  process.   In  like  manner  it  is  convenient 
to  coin  a  word  "taxicrinics"  to  refer  specifically  to  the  root  operations  of 
graph  manipulation,  search,  and  interpretation.   As  such,  it  is  distinguished 
from  programs  woven  from  these  primitive  taxicrinic  operations  for  the 
mechanization  of  language  translation,  compiling,  theorem  proving,  etc. 
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Some  problems  in  the  above  areas  have  formal  solutions  as  shown  by 
linear  programming  theory.   In  fact  most  soluble  combinatorial  problems,  like 
flow,  scheduling,  etc.,  have  been  handled  this  way.   Such  formal  solutions 
may  possibly  play  a  small  role,  whereas  new  iterative  techniques  adapted  to 
the  taxicrinic  unit,  more  analogous  to  iterative  root-finding  procedures  of 
numerical  analysis,  may  lie  more  at  the  core  of  effective  solution  procedures. 

It  would  be  premature  to  specify  the  logical  design  of  a  taxicrinic 
unit.   Certain  mechanisms  (bit  processing,  associative  memories,  list 
processing,  etc.)  have  been  suggested,  but  to  date  no  sufficiently  comprehensive 
design  proposal  exists.   We  can,  however,  emphasize  three  features  we  would 
expect  to  find  in  a  taxicrinic  unit: 

(i)    memory  organization  augmented  by  an  hierarchal 
instruction  set  for  convenient  and  natural 
manipulation  of  graphs, 

(ii)   use  of  parallel  computing  structures  with  delegated 
authority  to  make  decisions,  and 

(iii)  facilities  for  logical  matching,  applied  concurrently 
at  several  depths  in  a  decision  tree. 
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D)   ARITHMETIC  UNIT  (AU) 

In  what  way  might  the  arithmetic  unit  of  a  pattern  recognition 
computer  differ  from  an  arithmetic  unit  of  contemporary  design? 

First,  as  a  result  of  having  three  basic  processors  with 
attendant  specialization  of  function,  the  AU  can  be  stripped  of  all  non- 
arithmetic  and  indexing  functions.   Logical  operations  belong  properly  in 
the  taxicrinic  unit.   Indexing  is  executed  at  the  memory  interface  (as 
described  in  Section  III-A).   For  maximal  parallelism  it  is  convenient  to 
filter  out  indexing  instructions  at  the  interface  using  interlock  bits  to 
insure  synchronism  at  critical  steps,  and  transmit  only  arithmetic  instructions 
to  the  AU.   This  isolation  of  function  follows  the  precedent  set  by  the  New 
Illinois  Computer. 

Secondly,  it  is  necessary  to  anticipate  the  problem  mix  the  computer 
will  see.   The  principal  areas  of  application  might  be  estimated  to  be: 

1)  statistical  adjustment  and  interpretation  of  data: 
specifically,  multivariate  techniques  including  factor 
analysis  and  latent  structure  analysis;  parametric  fitting 
techniques  like  least  squares  and  maximum  likelihood. 

2)  stereo-geometric  reconstructions :   typified  by  the 
bubble  chamber,  spark  chamber  and  neurohistology 
stereo-reconstruction  requirements . 

3)  linear  programming:   allocation,  scheduling  and  flow 
problems  in  so  far  as  these  can  be  cast  into  this  form. 

h)     mult i -parameter  analysis:   analysis  of  mult i- channel 
stochastic  time  series;  for  example,  in  the  discrete 
case,  pulse  height  data  from  a  large  number  of 
channels  in  parallel  (counter  array,  etc.);  or  in  the 
continuium  limit,  from  multi-probe  neurophysiological 
recording. 

From  these  areas  of  application  the  following  conclusions  might  be 


drawn : 


l)  Areas  1,  2,  3  strongly  suggest  a  floating  point  unit 

with  a  32  bit  fractional  part  and  target  operation  time 
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of  1  (isec/instruction.   (For  example,  bubble  chamber 
data  processing  at  the  track  and  event  level  could 
then  be  held  to  under  1  sec/stereotriad. ) 

2 )  The  very  high  predominance  of  matrix  algebra  suggests 
that  speed  of  division  is  not  critical;  5  to  8  usee 
should  prove  satisfactory. 

3)  Polynomial  evaluation,  particularly  crude  evaluations 
with  only  few  coefficients,  will  play  a  critical  role. 
Means  to  expedite  their  evaluation  might  well  be 
incorporated  in  the  design.   (See  discussion  of  control 
memory  organization  later  on. ) 

k)     Area  h   for  sufficiently  low  data  rate  can  be  treated 
in  like  manner  to  Areas  1,  2  and  3«   The  other  limit, 
where  massive  numbers  of  channels  convey  in  parallel 
data  of  very  limited  accuracy,  can  often  be  better 
recast  as  a  recognition  problem,   and  handled  by  the 
taxicrinic  unit  (e.g.,  in  multi-probe  neurophysiology). 

One  design  approach  to  an  arithmetic  unit  of  this  capability,  realiz- 
able in  the  hardware  of  today,  is  to  enhance  the  parallelism  of  the  arithmetic 
unit,  and  abandon  the  traditional  mechanization  of  multiplication  (or  division) 
as  a  series  of  conditional  additions  (subtractions). 

2 
Recently  Wallace  has  suggested  an  organization  of  the  arithmetic 

unit  employing  a  static  multiplier,  i.e.,  all  recoded  partial  products  are 

added  together  in  parallel  in  a  convergent  tree  of  half -adders.   Multiplication 

times  under  1  usee  for  a  32  bit  fractional  part  seems  reasonable  using 

saturating  circuitry  similar  to  that  of  the  PAU.   It  is  therefore  possible 


A  number  of  appropriate  recognition  structures  are  suggested  in  the  report 
of  A.  H.  Amon,  ibid. 

2 

Christopher  Wallace,  private  communication.   A  detailed  exposition  of  this 

multiplication/division  algorithm  will  be  given  by  Wallace  in  a  forthcoming 

paper. 
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to  treat  addition  (subtraction)  and  multiplication  execution  times  as  roughly 
in  "balance.   The  last  barrier,  division,  has  even  more  recently  been  fitted 
by  Wallace  into  this  framework- -and  realized  by  a  minimum  number  of  trial 
partial  multiple at ions . 

The  Wallace  type  multiplier-divider  (which  includes  an  adder- 
subtracter  integrated  in  the  design)  can  be  augmented  by  a  static  shifter,  an 

exponent  arithmetic  unit,  and  by  a  straightforward  simple  control  to  make  an 

3 
ultra-fast  floating  point  arithmetic  unit.    Instructions  can  be  drawn  from 

any  one  of  the  four  memory  banks.   In  one  design  these  instructions  are  sent 

directly  to  the  arithmetic  unit  control.   Alternatively,  by  Interposing  a 

k 

control  memory  between  the  memory  interface  and  the  arithmetic  control,  each 

word  from  one  of  the  four  memory  banks  can  contain  one  to  four  macro- 
instructions,  each  identifying  a  micro-instruction  sequence  stored  in  the 
control  memory.   This  latter  arrangement  is  efficient  only  if  a  detailed 
examination  of  programming  for  areas  1  through  k   in  search  of  an  appropriate 
macro- instruction  set  proves  that  average  access  to  the  memory  banks  can  be 
cut  by  a  factor  of  four.   This  macro  set  can  be,  and  would  be  expected  to  be, 
problem  dependent.   This  situation  is  satisfactory,  however,  as  the  control 
memory  can  be  erasable,  and  in  fact,  identical  in  design  of  the  control  memory 
of  the  PAU. 


3 

The  author  wishes  to  acknowledge  here  several  helpful  discussions  with 

D.  B.  Gillies,  including  the  suggested  use  of  the  static  shifter. 

The  use  of  an  erasable  control  memory  of  512  words  of  64  bits  in  the  control 
of  the  PAU  is  discussed  in  Section  VI-E  of  Report  No.  122,  ibid. 
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e)  remarks  on  the  parallel  organization  of  processing  units 

We  have  seen  the  suggestion  for  parallel  construction  of  the  pattern 

articulation  unit  (PAU).   This  iterative,  modular  design  is  carried  out  in 

2  S 

some  detail  in  Part  II.    Again  we  have  the  suggestion  that  the  taxicrinic 

unit  might  employ  a  parallel  computing  structure  with  concurrent  allocation 

of  decision  making.  "Why  is  it"  we  may  ask,  "that  contemporary  computers  have 

avoided  the  parallel  mode  of  construction?" 

A  partial  reply  would  emphasize  three  points.   First  it  has  been 
possible  until  recently  to  absorb  expanding  computing  loads  by  leaving  the 
logical  organization  of  the  computer  largely  invariant  and  exploiting  newer, 
high  speed  circuit  and  memory  elements.   Secondly,  the  almost  exclusive 
emphasis  of  the  last  decade  on  automation  of  arithmetic  processes  centered 
attention  on  procedures  cast  into  parallel  form  only  with  difficulty. 
Arithmetic  computation,  of  the  type  for  which  machines  of  that  era  were 
fashioned,  consists  of  long  serial  chains  of  arithmetic  orders,  occasionally 
interleaved  with  a  transfer  instruction.   Thirdly,  parallelism  was  used  where 
it  could  be  used  effectively:  the  parallel  arithmetic  unit  does  predominate 
today;  its  serial  counterpart  has  been  relegated  to  space  systems  and  small 
data  processors  of  minor  importance. 

One  familiar  hierarchal  processing  structure  of  extensive  parallelism 
is  used  throughout  the  world- -the  factory.   Why  has  it  been  that  individuals, 
each  outstripping  any  contemporary  computer  in  internal  parallelism,  commonly 
group  together  to  form  factories?  What  intrinsic  organizational  advantages 
has  the  factory  for  a  society  of  human  beings  that  might  not  carry  over  into 
a  society  of  computing  modules,  i.e.,  the  parallel  computer. 

Human  beings  have  traditionally  banded  together  to  accomplish  tasks 
not  within  the  capabilities  of  any  one  man.   Man's  physical  abilities  readily 
saturate.   However,  a  computer  with  each  logical  component  giving  one 'hundred- 
fold faster  performance  is  at  least  an  engineering  possibility.   Direct 
comparison,  one  can  therefore  argue,  of  human  and  computer  organizational 
principles  is  not  relevant  at  this  stage  of  rapid  engineering  advance. 


Section  III-B. 

2 

B.  H.  McCormick,  Design  of  the  Pattern  Articulation  Unit,  Digital  Computer 

Laboratory  Report  No.  122  (1962). 
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Section  III-C, 
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However,  one  hundredfold  ranges  in  mental  ability  from  one  man  to 

k 
the  next  have  been  repeatedly  demonstrated.   Why  then  do  we  so  rarely  find 

offices  employing  exclusively  Ph.D. 's,  or  armies  (thankfully  small)  of  only 

generals?  An  interesting  corollary  to  this  situation  is  known  from  computer 

technology.   Early  magnetic  tape  transports  has  extensive  individual  timing 

and  control  circuitry.  With  evolution  this  circuitry  has  been  stripped  from 

the  individual  units  and  delegated  to  a  central  control  box  (time-shared  by 

ten  tape  units  typically)- -introduction  of  the  foreman,  one  might  say.   May 

not  some  managerial  aspects  of  factory  organization  have  a  rational  basis 

that  extends  to  the  logical  organization  of  the  parallel  computers? 

What  abstractly  led  to  the  factory  system:  mass  product ion- -fewer 
types  of  operation  per  worker  carried  out  iteratively  with  simpler  control. 
Alternatively,  if  every  worker  were  to  manufacture  one  piece  of  produce  from 
beginning  to  end,  and  iterate  this  procedure  day  in,  day  out,  he  would  need 
(in  computer  jargon):   i)  greater  memory  access,  ii)  a  richer  order  code, 
and  iii)  a  more  complicated  control  (i.e.,  per  plant:  more  supervisors, 
fewer  actual  workers).   Extending  this  analogy,  the  PAU,  with  its  10 
identical  modules,  has  an  excellent  counterpart  in  military  company  drill--one 
instruction  shouted  to  all  members  at  each  instant  of  time.   And  like  the 
military  analogue  if  processor  lacks  the  flexibility  to  do  anything  very 
brilliant,  but  is,  however,  well-matched  to  the  limited  task  at  hand. 

The  decision  hierarchy  employed  will  obviously  be  highly  problem 
dependent.   In  areas  like  much  of  arithmetic  computation,  a  pyramidal  structure 
with  all  decisions  relegated  to  one  control  point  is  possible.   This  managerial 
procedure  is  familiar  in  industries  (e.g.,  textiles)  with  well-established 
traditional  modes  of  productions.   In  other  areas  (e.g.,  electronics)  of 
rapid  technological  change,  the  funnellings  of  requisite  technical  information 
to  one  control  point  can  only  be  done  with  such  attrition  as  to  jeopardize 
the  entire  organization.   Here  delegation  of  decision  making  to  the  local 
level  is  essential  for  effective  use  of  the  system. 


k 

As  estimated  by  some  arbitrary  standard   such  as  rate  of  publication  in 

professional  journals. 
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By  analogy  with  the  evolution  of  the  modern  factory  system,  we  might 
expect  to  see  in  computer  design 

(i)    increased  specialization  of  processors  to  restricted  areas 

of  work  (as  multipliers  only,  etc.) 

Jl 

(ii)   distributed  control  (i.e.,  foremen) 

(iii)   compartmentalization  of  memory 

(iv)   increase  attention  to  internal  scheduling  problems, 
again  largely  handled  at  a  local  level 

(v)    establishment  of  one  or  more  units  of  utility  (i.e., 

money)  to  trade  off  alternative  deployment  of  processors. 

We  will  not  here  further  develop  possible  principles  for  parallel 
computer  organization  as  abstracted  from  a  study  of  factory  systems.   The 
factory  analogy  is  not  merely  amusing;  its  proper  expression  lies  at  the  root 
of  a  mathematical  theory  of  data  processing. 
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IV.   INTERIM  PHASES  IN  REALIZATION  OF  THE  COMPUTER 

Not  all  the  machine  need  be  initially  fabricated  to  have  a  useful 
computational  and  data  processing  instrument.   The  overall  construction  of  the 
pattern  recognition  computer  could  be  scheduled  as  a  sequence  of  five  phases. 
Starting  with  a  contemporary  arithmetic  computer  as  a  basis,  the  first  natural 
and  necessary  step  is  to  acquire  prototype  visual  i nput/ output . 

1)  Provide  the  contemporary  arithmetic  computer  with 
prototype  visual  i/O  (via  oscilloscope,  for  example). 

2)  Fabricate  pattern  articulation  unit  (PAU)  and  interpose 
between  visual  i/O  and  the  arithmetic  computer. 
Provide  production  quality  visual  I/O.   (System  now 
capable  of  bubble  chamber  data  processing,  etc.) 

3)  Add  arithmetic  unit  (AU),  two  memory  banks  and  simple 
memory  interface  to  absorb  increasing  work  load. 
(Conventional  i/O  still  relegated  to  the  original 
arithmetic  computer  and  its  associated  editing  unit.) 

k)     Fabricate  taxicrinic  unit  (TU),  expand  memory  interface 
and  couple  with  additional  memory  banks. 

5)  Add  buffered  i/o  channels,  editing  unit  for  conventional 
i/O,  magnetic  tape,  disk  file,  printer,  etc. 

One  of  the  more  difficult  periods  is  the  transition  between  phases 
(l)  and  (2)0   The  reduction  of  the  input  image  to  an  abstract  graph  must,  of 
course,  be  done  at  this  stage  within  the  arithmetic  computer.   One  is  sorely 
tempted  to  do  this  reduction  as  efficiently  (in  computer  time)  as  possible 
largely  using  arithmetic  orders  and  programming  as  tightly  as  possible.   This 
procedure,  which  attempts  to  convert  the  arithmetic  computer  into  a  pattern 
recognition  unit,  is  largely  ill-fated.   For  example,  half-time  rental  of  an 
IBM  709^  might  easily  accrue  to  $1,000,000  and  still  give  data  rates  one- 
tenth  those  attainable  with  the  PAU-based  system.   We  might  characterize  the 
situation  as  writing  code  well-matched  to  a  computer  ill-matched  to  the  task 
at  hand. 

An  alternative  strategy,  the  one  advocated  here,  is  to  write  (at 
this  phase  of  development)  code  ill-matched  to  the  contemporary  computer,  that 
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is,  write  in  a  language  (for  a  simulator  of  the  PAU)  well  matched  to  the  task 
but  inefficiently  run  on  a  contemporary  computer,,   Moreover  upon  completion 
of  phase  (2)  this  code  can  be  taken  over  directly  to  the  operational  PAU. 

As  for  the  later  phases  of  development,  the  order  of  fabrication 
(i.e.,  arithmetic  unit  or  taxicrinic  unit  first)  is  largely  arbitrary.   If 
one  contemplates  a  large  bubble  chamber  data  processing  load  for  which  the 
taxicrinic  (abstract  graph  manipulation)  aspects  of  the  problem  are  relatively 
slight,  it  might  be  preferable  to  absorb  the  arithmetic  computational  load 
first.   (Arithmetic  computation  would  be  transferred  to  the  new  arithmetic  unit 
at  a  compiler  language  level  (e.g.,  ALGOL).   On  the  other  hand,  if  the  demands 
of  library  automation  were  given  sudden  impetus,  then  a  taxicrinic  unit  would 
more  ameliorate  the  overall  processing  load  and  should  be  fabricated  first. 

Phase  (5),  though  listed  last,  is  largely  independent  of  other 
developments,  provided  preliminary  specification  of  the  memory  banks  are 
available.  This  fabrication  is  best  handled  commercially,  for  excellent 
equipment  exists  in  this  area  today. 

This  phasing  of  the  Pattern  Recognition  Computer  as  the  construction 
of  a  sequence  of  largely  independent  processing  units  should  not  be  viewed  as 
an  artificial  partitioning  of  the  overall  machine „   The  PAU  and  the  TU  are 
of  themselves  conceptually  interesting  computing  structures  of  totally  dif- 
ferent organization  from  any  contemporary  central  processing  unit.   These  units 
can  not  only  outperform  the  arithmetic  computer  in  their  area  of  competence, 
but  equally  important  do  this  through  a  simpler  logical  partitioning  of  the 
solution  algorithm.   It  is  not  unlikely  that  the  day  of  the  central  processing 
unit,  which  does  a  little  of  everything,  is  drawing  to  a  close.   This  older 
type  organization  may  well  find  itself  unable  to  compete  with  systems  allocating 
decision-making  to  semi -autonomous  processors- -the  introduction  of  a  factory- 
type  scheme  of  computer  organization., 
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